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Abstract. We report the first results of our ongoing campaign to discover the first brown dwarfs (BD) in NGC 2264, a young 
(3 Myr), populous star forming region for which our optical studies have revealed a very high density of potential candidates 
- 236 in < 1 deg^ - from the substellar limit down to at least ~ 20 Mj^p for zero reddening. Candidate BD were first selected 
using wide field (I,z) band imaging with CFH12K, by reference to current theoretical isochrones. Subsequently, 79 (33%) 
of the /, z sample were found to have near-infrared 2MASS photometry (JHK, ± 0.3 mag. or better), yielding dereddened 
magnitudes and allowing further investigation by comparison with the location of NextGen and DUSTY isochrones in colour- 
colour and colour-magnitude diagrams involving various combinations of I,J,H and Kg. We discuss the status and potential 
substellarity of a number of relatively unreddened (Ay S 5) likely low-mass members in our sample, but in spite of the depth 
of our observations in I,z, we are as yet unable to unambiguously identify substellar candidates using only 2MASS data. 
Nevertheless, there are excellent arguments for considering two faint (observed / ~ 18.4 and 21.2) objects as cluster candidates 
with masses respectively at or rather below the hydrogen burning limit. More current candidates could be proven to be cluster 
members with masses around 0. 1 Mq via gravity-sensitive spectroscopy, and deeper near-infrared imaging will surely reveal 
a hitherto unknown population of young brown dwarfs in this region, accessible to the next generation of deep near-infrared 
surveys. 
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1. Introduction early estimates of the substellar IMF in the solar neighbour- 
hood have indicated that BD are nearly as numerous as stars. 

Within the last few years the observational study of sub- Within this broad framework, two competing scenarios have 

stellar objects (M <0.072 M^) has undergone spectacular and ^gen put forward for BD formation; the first simply that they 

^ rapid development, revealing new perspectives on the for- f^^.^ ^s stars do, i.e. by the gravitational collapse of low mass 

- - mation of such objects within molecular clouds. Large molecular cloud cores (Padoan & Nordlund 2002 1; the second 

numbers of brown dwarfs (BD) have now been found postulates the dynamical ejection of the lowest mass protostars, 

in star-forming regions (SFRs), young clusters and the leading to BD for mation since the ejected fr agments are unable 

^f^. ^^^-Il^f '^!^",''^^^^-^""^' IChabrier 20021 to further accrete (|Reip urth & Clarke 2001^. To distinguish be- 

IChabrier 2003| |Cruz et al. 20UT) and p hysical models of ^ween these possibiHties and to obtain unbiased estimates of 

the atmospheres o f BD constructed ^Baraffe et al. 20031 the substellar IMF, observations of statistically complete, ho- 

IChabrieret al.2000|l, opening up the possibiUty of confronta- mogeneous populations of BD are needed in a wide variety of 

tion between observations and theoretical predictions of the environments with different ages 
physical properties of BD. However, the core issues of the 

form of the substellar initial mass function (IMF) and its de- Young star-forming regions are of particular interest since 

pendence on environment remain to be addressed. The discov- the youth of such objects ensures that their population has 

ery of BD in widely differing environments does suggest their not yet suffered from important dynamical (and stellar) evo- 

formation is directly linked to the star formation process, and lution, other than dynamical effects potentially associated with 

their formation. This is a point worth underlining, since ob- 
Seiid offprint requests to: TR. Kendall servations of young SFRs have the potential to distinguish 
* Based on observations made with the Canada-France-Hawaii tele- these two BD formation mechanisms by their resultant spa- 
scope and data from the 2MASS project (University of Massachusetts tial distributions. If BD always form exactly as stars do, one 
and IPAC/Caltech, USA.) would expect them to trace the regions of the highest den- 
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sity of low-mass stars. However, in any dynamical ejection 
scenario, a deficit of BD may be expected in the central re- 
gions of young star-forming clusters. Their initial velocities 
of a few kms ' JSterzik & Durisen 2003j would especially 
imply a preferential loss of BD from loosely bound regions 
such as Taurus, where a velocity of Ikms"' would corre- 
spond to a drift of ~0.37Myr at 140pc (or in absolute terms 
~0.7pc/Myr). In denser environments, BD would remain 
bound, but pVToraux & Clarke (20 04) found that BD would still 
be expected to have a more extended distribution than the stars, 
in clusters whose age is comparable to the crossing time. Such 
a difference in spatial distribution should be observable in all 
nearby such SFRs; we note also that other models predict rather 
similar dispersion velocities for BD and more massive mem- 
bers dBate et al. 2003> . Wide field observations of large BD 
samples in these regions will soon settle this issue. 

Young BD (with ages 1-3 Myr) are now being uncovered 
(for a relatively recent compilation see Basri 2000 ^1. but the 
census remains very incomplete to date. Comparison between 
the BD populations of young SFRs with a range of environ- 
mental conditions permits investigation of the sensitivity of the 
low-mass end of the IMF to local conditions, and other more 
recent studies are beginning to address this question. To cite 
two specific cases, 30 substellar candidates have been identi- 
fied in Taurus in a 3.6 deg^ region using CFH12K data which 
reached to 7 = 23.5. Spectroscopic follow-up led to the iden- 
tification of four BD in Taurus with spectral type later than 
M7 (.Martin et al. 2001 J . In Taurus, -10 BD are now known 
( |Briceno et al. (2002)^ , and appear to be spatially correlated 
with regions of highest stellar density. In Upper Scorpius, ini- 
tial studies ( Martin et al. 2QQ4i have found 1 8 candidate BD of 
which 5 show signs of ongoing accretion. 

In this paper, we present initial results from a deep 
CFH12K survey of the young (3 Myr), rich star-forming re- 
gion NGC 2264. The study introduced here is only a small 
part (0.6 deg^) of a much broader survey, which has mapped 
significant areas (70deg^) of a variety of environments (ages 
1-600 Myr) sufficiently deeply to probe BD; in all of the tar- 
geted regions, the limiting mass is in the range 10^0 Mjup. 
NGC 2264, because of its youth and relative proximity (3 Myr, 
760pc;lLamm et al. 2004IIRebull et al. 2002l|Sung et al. 1997| 
IPark et al. 200 0'^. is probed to the lower end of this mass range 
with the current observations. We will discuss our initial find- 
ings on NGC 2264 in Sect. 4; here we will note that the much 
larger coeval BD populations currently being uncovered by 
CFH12K, when fully analysed, promise a more robust statis- 
tical treatment of both the kinematics of BD populations and 
variations in the substellar IMF from region to region. 

2. Observations of candidate NGC 2264 members: 
Optical colour selection 

Observations of NGC 2264 were carried out using the Canada- 
France-Hawaii Telescope (CFHT) and the 12K camera, with 
a mosaic of 12 4128x2080 ISfim pixel CCDs as detector 
yielding a field of view of 43' x 28' with 0.206" pix '. 2 fields 
were observed in the /-band on 2 February 1999, and the same 
fields covered in the z-band on 19 December 2000; in both 
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Fig. 1. /, / - z colour-magnitude diagram built using long 
(3 X 360 sec) exposures of NGC 2264. The solid isochrones are 
DUSTY models for ages of 2 and 5 Myr; the dashed isochrones 
are the NextGen models for the same ages. All isochrones are 
for distance modulus 9.4; 760 pc. 236 BD candidates (squares) 
were selected to be redward of the sloping straight line (long 
dash). Small dots redward of this Une were rejected from the 
candidacy on visual inspection. Typical error bars for / = 22 of 
~ 0. 1 mag are shown. The mass scale (in M©) is for the 2 Myr 
models; it and the estimated completeness limit are indicated. 

cases each observation is a composite of 3 x 360 second ex- 
posures. Weather conditions were good and the seeing 1.2" 
or better The pre-reduction and analysis of these data have 
been performed using CFHT Elixir ' pipelines and new, innova- 
tive point-spread function (PSF) fitting techniques (SExtractor, 
PSFex) developed at the Institut d'Astrophysique de Paris 
by E. Bertin JBertin & Amouts 19961 1^. After pipeline image 
flat-fielding and co-addition, z-band images (taken at a later 
epoch) were mapped on to the /-band images using standard 
techniques (geomap, geotrans) within the IRAF ^ environment. 
Photometric extraction was initially performed on the /-band 
images, with subsequent matching to the z-images with an ac- 
curacy of ± 5 pixels. The assessment of photometric zeropoints 
at / was provided using images of the Landolt standard field 
SA 101 (Landolt 1992 1, observed with the same instrumental 
setup at the same epoch. Where there were sufficient standard 
stars in each individual CCD of the array (around half the 12 
CCDs) CCD-to-CCD variations in the zeropoint could be es- 

' www.cfht.hawaii.edu 

- see www . terapix .iap.fr for more recent developments 
IRAF is distributed by the National Optical Astronomy 
Observatories, which is operated by the Association of Universities 
for Research in Astronomy, Inc. (AURA) under cooperative agree- 
ment with the National Science Foundation 
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timated, compared with the Elixir pipeline values (no discrep- 
ancies larger than 0.1-0.2 mag. were found) and taken into ac- 
count in our analysis. For the other /-band observations, ze- 
ropoints were taken directly from the night-by-night CFHT/ 
Elixir database; this was also the case for the later-epoch z- 
band observations, which are calibrated assuming I - z-Q for 
AO stars. We estimate our typical random photometric errors 
to be +0.1 mag. at / = 23 and + 0.05 mag. at / = 22, allowing 
us to place typical error bars in Fig. ^ which pertain near the 
completeness limit. 

We performed a number of sample refining and cleaning 
procedures as follows; firstly; photometric points found to have 
undefined magnitudes following PSF-fitting were rejected; this 
accounts for many detections close to bad columns, in diffrac- 
tion spikes, etc. Candidates flagged to be saturated and/or near 
field edges were then also removed. At this point, the statistics 
of the remaining detections, placed in one-magnitude bins in 
/, suggested that the data should be complete to very nearly 
1-23, there being very similar numbers of objects in this 
faintest bin and one magnitude brighter Subsequently, we re- 
tained only objects with a fraction-of-light radius ("flux ra- 
dius") within quite narrow ranges estimated by eye by looking 
at plots of this quantity versus magnitude. For example, in / 
only objects with a value of between 2 and 3.5 pixels were re- 
tained. Furthermore, we rejected objects with an ellipticity of 
greater than 0.15, in a very efficient attempt to rid our sample 
of extended or non-stellar objects. (To illustrate this, only one 
of 236 visually inspected candidates failed the ellipticity cut; it 
is clear that this cut is an efficient way of refining the sample, 
avoiding individual inspection of spurious points). As a final 
check on our selection, all 236 such /, z candidates (squares in 
Fig.^J were carefully inspected visually on both / and z frames 
and all found to be stellar in nature, i.e. there are no artifacts 
due to nebulosity, field edges, bad columns, bright stars etc. 
After all these steps, we retained all 236 candidates but only 
plot field objects satisfying e<0.15, and all other criteria, in 
Fig-d (Hence, the one candidate failing this criterion is the 
only point in Fig.^to be plotted as an open square with no 
inner dot). We find that the number of objects with / = 22-23 
is roughly 50% of the number in the 7 = 21-22 range; hence 
a completeness limit in the refined sample of 7 ~ 22 is reason- 
able. We note that we made no attempt to remove candidates 
on the basis of their magnitudes only; our cuts have rejected no 
fainter candidates, but a much larger number of points which 
prove, for one reason or another, clearly spurious on inspec- 
tion. Finally, astrometric calibration was carried out for each 
individual candidate using the Starlink astrom package. With 
an initial selection of ~ 10 stars within the same CCD as the 
candidate, and input positions taken from the USNO A 2.0 cat- 
alogue, we found RMS accuracies of the initial fits to better 
than 0.1". 

Fig E shows optically selected candidates in NGC 2264 
between the substellar limit and ~ lOMjup, by comparison 
with the state-of-the-art DUSTY models, specially created by 
Baraffe et al. to take account of the CFHT I,z filter responses 
(see IBaraffe et al. 20031 and references therein for full details 
of these models). In order to account for uncertainties in the 
model loci, and remain conservative in our candidate selec- 



Maximum error 



o 
o 



o 

00 



CCD 




Loci of observed colours for dwarfs 
Extrapolation of observed loci 



Fig. 2. All 79 IzJHKs candidates (open circles), plotted in the 
I - J, J - Ks diagram. The errorbar assumes JHKg accurate to 
+ 0.3 mag and 7 to +0.1 mag. The reddening vector is shown. 
The solid lines are observed loci of dwarfs taken from a com- 
pilation of sources (see text). The dash-dot line is a the locus 
of GO - M5 giants from |BesseU & Brett (1988) Av has been 
computed by dereddening all points to the extrapolated (dotted) 
locus of dwarfs. After dereddening, all objects are potentially 
either cluster or field M-dwarfs. 

tion, all objects redward of the sloping dashed line in Fig.[2 
were retained for further investigation. As can also be seen in 
Fig.ID our estimate of completeness to I ~22, or 12Mjup for 
age 2Myr (unreddened), appears accurate. 

3. Dereddening the sample 

In this section, we discuss our methods to estimate the extic- 
tion towards each member of our candidate sample. A brief 
examination of the reddening derived by previous authors is 
relevant at this point. At the galactic coordinates for NGC 2264 
given bylRebull et al. 20021 (/ = 202.96, b = +2.22) the maps of 
"Schlegel et al. (1998)' yield Ay =5.63, but it is considered that 
a background dark molecular cloud exists ( Rebull et al. 2002V 
limiting contamination by background giants. Indeed, these 
authors find a typical extinction towards NGC 2264 mem- 
bers Av ~ 0.45 (from photometry and spectroscopy of late- 
type members), in good agreement with earlier values de- 
rived using small numbers of OB stars (Sung et al. 1997| 
IPark et al. 2000) . Noting that the foreground reddening is ef- 
fectively zero ( |Sung et al. 1997^ , we therefore assume that Av 
toward any given object in our sample may vary from zero to 
high values. Futhermore, with such large and variable extinc- 
tion intrinsic to NGC 2264, it is clear that there may be rel- 
atively unreddened objects (perhaps on the nearer side of the 
cloud), and more deeply embedded objects. 
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Fig. 3. Similar to Fig.|5] but for JHKs- Since the colours plot- 
ted here vary relatively less among the sample, the errorbars 
appear larger. Therefore, a distinction has been made between 
the best 2MASS photometry (all magnitudes flagged A, filled 
points) and those with any magnitude flagged B or C. For the 
former, JHKs are taken accurate to +0.1 mag., for the latter, 
+ 0.3 mag., hence the errorbars plotted. Again, Av has been cal- 
culated by dereddening to the extrapolated (dotted) locus of 
observed late-type dwarf colours. The locus of giant colours is 
also plotted (dash-dot line). 

We find variable extinction values ranging up to Av ~ 15, 
but generally in the range 0-10. Our methods rely on the 
recovery of 79 objects in our sample of 236 (33%) in the 
2MASS database^, where 2MASS detections were required to 
be within 2 " of our optical positions. More 2MASS counter- 
parts exist, but with either J- or /Tj-magnitudes only given as 
upper limits - we do not consider these objects further. The 79 
objects will form the basis of the current study; all have photo- 
metric flags A, B or C, corresponding to errors +0.1 mag (A) 
to +0.3 mag (C). 

The basis for dereddening is given in Figs. |2l and |3l We 
have used observed loci for late-type dwarfs from compilations 
given by Leggett (1992), Legge ttetal. (19 98) Bes sell (199T)| 
and ,Kirkpatrick et al. (2000). to compare the location of our 
sample in the I — J, J - and J - H,H - Kg colour-colour 
diagrams. In order to verify our methods we first checked our 
sample for obvious Ks-hand excesses, which would strongly af- 
fect estimates of the extinction which used the A', -magnitude. 
We found none (Fig.|3. 

We plotted the location of our sample in I - J, J - Kg, in 
which diagram the location of an unreddened M-dwarf locus 
can be easily described by a straight line (Fig.|2j- From the 
known slope of the reddening vector ( |Rieke &Lebofsky 1985. 1 

www.ipac.caltech/edu/2MASS 
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Fig. 4. To check for obvious Ks-hand excesses which may af- 
fect our derivation of Ay, we have plotted all 79 candidates in 
the I - J,I - Ks diagram. Clearly, no objects have significant 
excesses. 



and the gradient of the line (dotted in Fig.|2ji the magnitude 
of the vector Ay can be calculated via simple geometric argu- 
ments. Exactly similar arguments can be applied in the case 
of Fig.|3] where only near-infrared colours are utilised. In this 
case, the photometric errors are larger, with respect to the range 
of JHKs colours observed. Hence, in Fig.|3l we make a clear 
distinction between those objects (42 out of 79) which have 
precise 2MASS photometry and those for which the errors are 
likely larger than + 0.1 mag. We find that the values of Ay found 
by these two methods are almost identical, aside from a few ob- 
jects for which Ay is low and the difference between the value 
of the extinction given by the two methods is of order ~ 1 mag. 
(Fig.|5}, which is not a significant difference in the context of 
this work. Hence, in order to retain the important /-band mag- 
nitude for further analysis, we prefer to adopt Ay given by the 
J - H and H - Kg colours, throughout the remainder of this 
paper. We note here also, that in addition, we performed simi- 
lar experiments using a locus in the / - Ks,J - H diagram, as 
adopted by |Luhman et al. (2003)| for a study of the Taurus SFR, 
and found very similar values of Ay in excellent agreement 
with our preferred methods. Lastly, we are aware that dered- 
dening to dwarf loci may not be correct for NGC 2264 at age 
3 Myr, since young objects have surface gravities intermedi- 
ate between dwarfs and giants JGreene & Lada 1996) . To illus- 
trate this uncertainty, we have plotted the loci of giant stars of 
spectral type G0-M5 from the data of 'Bessefl & Brett (198*8)1 
as dash-dot lines in Figs.|2]and|3] The plotted giant sequence 
ends at M5. With reference to Fig.|2] one might assume that it 
would continue roughly parallel to the dwarf sequence; we do 
not have data to confirm this. Were it the case, however, one 
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Fig. 5. Comparison of Ay derived by the two different methods 
indicated by the axis labels and detailed in the text. Both meth- 
ods yield very similar values. The dotted line denotes equal Av 
from each method. We have singled out eight objects with low 
reddening, lying to the left of the sloping line, plus two more 
objects highlighted by open squares, for particular discussion. 
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Fig. 6. The I - J,I - Ks diagram, after dereddening. All objects 
lie close to the theoretical DUSTY and/or NextGen isochrones 
(dotted and dashed lines, respectively). The substellar limit for 
suggested by each set of models is indicated; with reference to 
DUSTY models, many objects are potentially substellar The 
typical errors are the same as in Fig.|3 



can see from inspection that dereddening to a locus interme- 
diate between dwarfs and giants might yield Ay systematically 
lower than our estimates, by about one magnitude. Hence our 
dereddened /-magnitudes would be fainter (by about 0.5 mag.) 
and closer to the observed values, and faint candidate mem- 
bers would therefore be more likely to be substellar with ref- 
erence to theoretical models. One might also argue that, from 
Fig.|5] the values of Ay derived from the J - H,H - Ks colour 
lie above the line of equal Ay with respect to the values from 
I -J, J-Ks, again by about 1 mag. Hence by choosing to use Ay 
derived from JHK colours, we might have overestimated Ay by 
~ 1 mag, thus Ai by ~ 0.5 mag. In that case, the true values of 
dereddened / may be fainter by ~ 0.5 mag., and the masses cor- 
respondingly lower For these reasons, our derivation of dered- 
dened magnitudes is conservative. 

It is worth noting here that Fig |3 suggests that we do not 
observe /T-band excesses, which generally suggest the pres- 
ence of an accretion disk. We have re-plotted this diagram in 
Fig.m for dereddened colours. The reader is encouraged to 
compare Fig.|6lwith the Fig. 3 of |CabaIIero et al. (2004)| which 
shows the same plot for a number of cr Orionis young brown 
dwarfs, only one of which shows a clear /Tj-band excess. For 
NGC 2264, it is not possible to disentangle the effect of the in- 
trinsic reddening with the effects of accretion phenomena using 
near-infrared colours only; observations at longer wavelengths 
are required. 

4. Discussion 

In this section we will discuss and interpret the nature of 
our sample by consideration of their dereddened locations in 
a number of colour-colour and colour-magnitude diagrams, 
with respect to theoretical DUSTY and NextGen models 
(IBaraffe et al. 20031 and references therein) and other loci de- 
rived observationally. Initially, we have treated our values of 
Ay as exact, deferring a discussion of uncertainties until Sect. 
4.3. Hence in Figs. to [TO] the errorbars reflect only the ob- 
served photometric uncertainties. In Fig.0is plotted the / - 
vs. J - H diagram. The J - H colour is in itself not a diag- 
nostic; all points lie in the range 0.4-0.8 which is compara- 
ble to the likely error in this colour from 2MASS, at least for 
those objects with poorer quality photometry. However, regard- 
ing the / - Ks colour, it can be seen that a large range is cov- 
ered by our points, spanning likely solar-mass or higher pre- 
main sequence (PMS) stars (according to the NextGen mod- 
els) all the way down to around 50 Mjup or even lower, where 
DUSTY model predictions become appropriate. Our photome- 
try is not accurate enough to distinguish whether a given point 
lies preferentially near a DUSTY or NextGen model, at any 
mass where the model predictions overlap. Of course, at the 
3 Myr age of NGC 2264, an object at the substellar limit would 
have spectral type ~M6-M7, above the temperature (2500- 
2600 K or M9/L0) at which dust formation becomes impor- 
tant in the atmospheres of low-mass objects; proven associa- 
tion with a DUSTY isochrone must imply a mass well below 
this, as the mass scales plotted in Fig.0and subsequently show. 
It is clear from Fig.Qthat almost all points lie at positions ex- 
tremely consistent with the predictions of NextGen isochrones. 
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Fig. 7. The sample, plotted in the / - Ks, J - H diagram, af- 
ter dereddening. The dotted lines represent DUSTY isochrones 
for ages 1 and 5 Myr; the dashed lines are NextGen models for 
2 and 5 Myr. The dash-dot line is a locus of observed dwarf 
colours. The eiTorbar in 7 - // is large, but mass scales for 
the mean of each pair of isochrones are derived from the much 
more diagnostic 7 - /T^ colour, and are shown for DUSTY mod- 
els (at left) and NextGen (at right). Note that the errorbars do 
not reflect uncertainties in Av itself in this or subsequent fig- 
ures (until Fig. ^2 see Sect. 4.3). The whole sample is repre- 
sented by open circles; points with the best 2MASS photom- 
etry (all magnitudes flagged A) are doubly overplotted open 
symbols. The small filled squares are 65 candidate late-type 
cluster members (Lamm et al. 2004) recovered in our sample 
(see text); bold triangles are confirmed variable PMS objects 
drawn from the same sample by these authors. 



This is borne out by a cross-coiTelation of the 79 objects in our 
sample with a much larger dataset of 10554 objects in the field 
of NGC 2264 JLamm et al. 2004 ) . by which we recover 65 ob- 
jects, plotted as small filled squares in Fig.0and subsequently. 
However, it should be cautioned that by no means all these ob- 
jects are confirmed members. Further cross-correlation reveals 
only four confirmed PMS periodic variables, which are plot- 
ted as bold triangles in Fig.0and Fig.|Sland also as triangles in 
Fig.|9] We note we have no objects in common with the sample 
of Rebull et al. (2002), because their limiting magnitude is only 
7-17.9. 

It is clear that the vast majority of our faint sample 
have colours consistent with the NextGen isochrones for 
NGC 2264. Of course, some fraction could be foreground 
field stars; the dash-dot line in Fig.0 represents such a lo- 
cus of observed dwarf colours given by [Leggett (1992)1 and 
[Kirkpat rick et al. ( 2000) We do not yet have data to distinguish 
the cluster and field objects by, for example, gravity-sensitive 
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Fig. 8. As Fig.0 but for dereddened 7-/^5, 7- TT,. Again, mass 
scales are derived using the 7 - colour, with typical errobar 
shown. The error in 7 - TT, is large, but it is seen that most 
candidates lie in a space quite consistent with either NextGen 
or DUSTY models for the cluster (assumed distance modulus 
9.4). 



near-infrared spectroscopy (ILucas et al. 200 It . We will return 
to the topic of foreground field contaminants in more detail in 
a later section. 

Fig.|8]is similar to Fig.0except we have plotted the 7 - Ks 
colour instead of H - K^. Doing so alleviates sUghtly the prob- 
lem of potential large errors in the 2MASS photometry, if only 
because the 7 - Ks colour has a larger intrinsic scatter in the 
sample. Yet, while we are still unable to differentiate between 
NextGen and DUSTY model predictions here, almost all ob- 
jects are located consistently with their being NGC 2264 mem- 
bers. Furthermore, a few at the low-mass tip of the NextGen 
isochrones could be substellar members; clearly for the ob- 
jects lying near the BD limit of the DUSTY isochrones, fur- 
ther observations are required to disentangle bona-fide substel- 
lar members from higher mass members and field objects. 

For the cuiTent study, we need to rely on the absolute mag- 
nitudes to yield a truer picture of the status of the objects in 
our sample. In Fig.|9lwe plot 7 vs. I - Ks, in Fig.no|7 vs. I - J. 
The zero-age main sequence (ZAMS) is plotted as a long/short 
dashed line for spectral types earlier than M5; we have used ab- 
solute V-magnitudes from Allen (1973) together with observed 
colours ( ^Kenyon & Hartmann 1995., Leggett 1992; Kirkpatrick 
et al. 2000). As should be the case, all points lie above the 
ZAMS in a region where PMS stars would be located. In no 
cases are the loci of DUSTY models well populated; with 
the obvious reason that the 2MASS photometry utilised here 
is not sufliciently deep to probe so far below the substel- 
lar limit. Nevertheless, these plots demonstrate that our I,z- 
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dereddened I — K 

s 

Fig. 9. The dereddened 1,1 - diagram. The 65 objects we 
have in common with the sample of Lamm et al. (2004) are 
plotted as small filled squares; objects with 2MASS photome- 
try flagged AAA are overplotted as open octagons. The error- 
bar for / is +0.1 mag. which is an overestimate for the brighter 
part of the sample. Note that the errorbars do not take into 
account uncertainties in Ay; i.e. this quantity is treated as ex- 
act. Large open triangles indicate the four previously identified 
NGC 2264 members from Fig.0 Mass scales are shown for 
both NextGen and DUSTY models (dashed and dotted lines, 
respectively). The long/short dashed line is the zero-age main 
sequence (see text). The dash-dot line is a 5 Gyr field model, 
chosen for distance modulus 4 (63 pc), chosen to fit the 2 ob- 
jects with / - ^Tj > 3.8 which are discussed in the text. All other 
objects have locations with respect to the isochrones consistent 
with them being cluster members with masses above 0. 1 M© 
(NextGen) but the existence of a few objects very close to the 
substellar limit is not ruled out by the DUSTY models. The 
most likely such objects are overplotted by bold squares, and 
will be discussed in the text. Bold hexagons highlight two fur- 
ther objects whose candidacy wiU be discussed. 



selected sample, as presented here, may well contain some ob- 
jects at or very close to the substellar limit, with /-magnitudes, 
after dereddening, consistent with both low mass and cluster 
membership. Such objects lie close to /= 18 and near the tip 
of the DUSTY isochrones at 72 Mjup, and may either be cluster 
BD or slightly more massive (~ 0.1 M©) members according to 
the NextGen predictions. 

4.1. Likelihood of NGC 2264 membersiiip for selected 
low /Av candidates 

In the following discussion, we concentrate on the eight ob- 
jects listed in Table 1 and overplotted as bold squares in Figs.|51 



^2 - NextGen mass 

\ 

(Msun) 



Typical errors 

I 1 1 




dereddened I — J 
Fig. 10. As for Fig.|51 for dereddened 1,1 - J. 



and 1101 As a group, these candidates are faint (/~ 17-18 af- 
ter dereddening) and lie close to the BD limit as suggested 
by DUSTY models, but with higher masses ~ 0.1-0. 15 Mq 
from the NextGen models. Clearly, all are excellent low-mass 
NGC 2264 candidates. Only one is a known variable PMS star 
recovered in the sample of Lamm et al. (2004), as can be seen 
from Fig. 121 These eight objects are selected to have low Ay, 
lying to the left of the sloping line in Fig.|5] Their observed 
/-magnitudes lie in the range 17.9-18.6 with I - J ~2; one ob- 
ject lies on the DUSTY isochrone in Fig.0with dereddened 
I -Ks~2.% and Ay ~ 1 .6, and is a potential ~ 30 Mjup object by 
this comparison. Its dereddened /-magnitude and UK^ colours 
place it at the tip of the 2Myr DUSTY isochrone in Figs.|5] 
and ^1 yielding a mass at the substellar limit for age 2 Myr. 
Dereddening using UK^ colours only yields Ay - 3.3. This ob- 
ject is a good candidate cluster object with potentially substel- 
lar mass. Alternative explanations are that, by reference to a 
5 Gyr field isochrone (not plotted), it could be a ~ 0.15 Mq ob- 
ject at ~ 220 pc. Such is also suggested by it lying close to the 
ZAMS with spectral type M5. Presumably it is insufficiently 
reddened to be a background giant, behind both NGC 2264 it- 
self and the more distant background dark cloud. If this object 
is in front of the cloud, its extinction can only be explained 
by invoking a nearby, hitherto unnoticed, source of reddening, 
in the foreground of NGC 2264. If a background giant, with 
I-ll.l after dereddening and spectral type M5, it has My =- 
0.8 (Allen 1973) and V - / ~ 3 (Bessell & Brett 1988). Its dis- 
tance would then be an unfeasibly large 200 kpc. If instead it 
is a reddened giant of GO type (My = H-1.1, V - 1-0.8) then 
its distance would still be ~ 30 kpc. It is highly unlikely to be 
a giant at these distances, especially as it is located close to 
the galactic plane. Since neither the foreground dwarf or back- 
ground giant hypothesis can explain all the observed charac- 
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Table 1. Observed and derived data for NGC 2264 candidates discussed Sect 4.1 (the first eight) and Sect 4.2 (last two listed). 
Columns 7, 8 and 9 give respectively the Ay derived from near-infrared colours, and the dereddened / and 7-magnitudes. 
Uncertainties in JHK are taken to be ±0.1 mag. and + 0.3 mag. for flags A and C respectively, yielding errors in Ay ± 1 mag. for 
flag A, + 3 mag. for flag C. These errors are carried through to the dereddened magnitudes (see text for details). 



2MASS designation 


/ 


J 


H 


K 


Av 


der. / 


der. J 


2MASS flag 


2MASS J06395722+0941011 


18.09 


16.00 


15.27 


14.87 


1.39 


17.4 + 0.5 


15.6 + 0.3 


AAB 


2MASS J06400642+0944197 


18.27 


16.10 


15.28 


15.23 


1.04 


17.8 + 0.5 


15.8 + 0.3 


AAC 


2MASS J0640 105 3 +0939557 


18.39 


15.65 


14.66 


14.24 


3.49 


16.7 + 0.5 


14.7 + 0.3 


AAA 


2MASS J06410604+0949232 


18.00 


15.71 


15.03 


14.70 


0.89 


17.6 + 0.5 


15.5+0.3 


AAB 


2MASS J06402759+0945464 


18.05 


16.08 


15.38 


15.09 


0.86 


17.6 + 0.5 


15.8 + 0.3 


AAC 


2MASS J06405674+0938101 


18.64 


16.40 


15.49 


15.15 


2.65 


17.4+1.0 


15.7 + 0.6 


BAG 


2MASS J06413132+0935120 


17.95 


15.55 


14.86 


14.26 


1.77 


17.1+0.5 


15.1+0.3 


AAA 


2MASS J06401789+0941546 


18.44 


16.40 


15.82 


15.00 


1.58 


17.7 + 1.5 


16.0 + 0.9 


CBB 


2MASS J06404873 +09390 17 
2MASS J06411281+0945529 


21.25 
20.80 


16.80 
16.74 


15.97 
15.61 


15.32 
14.69 


2.97 
6.00 


19.8 + 1.5 
17.9+1.5 


16.0 + 0.9 
15.1+0.9 


CCC 
CBB 



teristics of this object, it is most likely, in our opinion, to be 
an NGC 2264 member with mass at or close to the BD limit. 
We note that it has no counterpart in SIMBAD within 9 "; the 
object LBM 2808 (Lamm et al. 20041 is 10 " distant and much 
brighter (/ = 16.08). Both are clearly visible on the 2MASS K^- 
band images where the fainter object examined here is a clear 
point source. Its cc_flag = 000, so the photometry is uncontami- 
nated; the gaLcontam and mp_flg are also both zero; the object 
is not associated with any extended 2MASS source, nor any 
solar system object. 

As noted, this object has characteristics in common with 
seven other objects also plotted as bold squares in Figs.|5]and 
[TOl low Av in the range 0.8-3.5 from the 7 -//,// - K, 
colours, and therefore dereddened /-magnitudes suggesting 
low masses. Taken as a group, it is possible to investigate 
whether they might be background giants, using similar ar- 
guments to the above. If we adopt I -11, after dereddening, 
and Mv - which would be the case for an early K-type gi- 
ant, then with V - I -1.2 (approximately K2III after Bessell 
& Brett 1988), we find a distance of 44kpc. The dereddened 
/-magnitudes of our sample are generally fainter than this 
(Fig.llO> so derived distances for the eight objects could range 
up to ~70kpc (for /= 18). Hence, we consider background 
contamination extremely unlikely, although it cannot be abso- 
lutely ruled out without spectroscopy. 

Lastly, for these eight objects we may consider the dered- 
dened /-magnitude (Table 1). For a range between 15 and 16, 
and adopting Mv - and V - J ~2 (again derived from the 
colours of an early K-type giant), we find a distance range be- 
tween 25 and 40kpc. While the distances are feasible, given 
the moderate reddening and low galactic latitude, it would 
seem unlikely that these are very distant objects lying beyond 
both NGC 2264 itself and the background molecular cloud. 
NGC 2264 membership is much more likely, yielding masses 
between the substellar limit and ~ 0.2 from the dereddened 
/ magnitude (Fig.llO> using NextGen isochrones. 



4.2. Two further cases 

Here, we return to examine the cases of the two objects in 
Fig.|9l and [TO] which are marked by bold hexagons. They ap- 
pear to be preferentially selected by their locations close to 
DUSTY isochrones in Fig.0 and are the only two objects with 
I-Ks > 3.5; potentially they are cluster members well below the 
substellar limit. They are very faint, red objects with observed 
/~21, dereddened /~ 18 and 20 and dereddened 7~ 15 and 
16; their Av are indicated by the open squares in Fig.ls] Both 
are also potentially field objects, lying on a 5 Gyr isochrone 
plotted for ~ 60 pc, chosen to select both objects from their /- 
magnitudes. 

Firstly, we will consider the faintest and reddest object, 
with / - K,~4.S (Fig.|7} and dereddened / ~ 19.8 (Fig.|^. If 
a foreground dwarf, its absolute / and 7-magnitudes suggest 
it has a mass between 0.075 and 0.08 with respect to the 
5 Gyr isochrone; just above the BD limit. From its near-infrared 
colours only, we derive Ay = 3, extremely unlikely for an object 
so relatively close. Av derived from the observed I - J, J - 
colour (Fig.|2j is 0.85. This lower value is also rather unlikely 
for an object in close proximity, even near the galactic plane. 
Nevertheless, it might be that this object is indeed a reddened 
(Av ~ 1-3) dwarf at ~ 60 pc, with a mass just above the brown 
dwarf Umit, and hitherto unnoticed in the galactic plane. There 
is no counterpart in the SIMBAD database within 10". Were 
it an NGC 2264 member, its absolute /-magnitude would sug- 
gest a mass of 30 Mjup; but rather higher from the 7-magnitude. 
The current data are unable to tell with certainty whether this 
object is an NGC 2264 member, or a foreground star However, 
it cannot be a background giant; it is too faint, unless it is a very 
massive star For example, for a GO giant with Mv = +1.1 and 
V - /~0.8, then the distance is ~80kpc; and an intrinsically 
brighter giant with earlier or later spectral type would be even 
more remote. Taking all the evidence presented here, we con- 
sider that this object is most likely to be an NGC 2264 member 
with potentially very low mass. However more accurate pho- 
tometry than provided by 2MASS (this object is flagged "C" 
for all magnitudes) is needed. 
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We now turn to the second of these objects, with I—K^ ~ 3.8 
and dereddened 7-18. Again there is no SIMBAD counterpart 
within ~8 "; the object referred to by Lamm et al. (2004) as 
LBM6160 (their Table 4) is within 10", but is much brighter 
(I = 16.14), not a confirmed cluster member according to these 
authors, and clearly not the same object as discussed below. For 
our candidate, both methods of calculating Ay yield a value be- 
tween 5 and 6; it also lies along the field 5 Gyr, 60 pc isochrone 
which suggests a mass between 0.08 and 0.09 M©. It is ex- 
tremely hard to see how a nearby object could be so reddened, 
and similar arguments to those presented above do not pro- 
vide a plausible case for the object being a background giant; 
with GO giant characteristics, its distance would be ~ 30 kpc. 
Inspection of Fig.|5] suggests it might be more likely to be a 
cluster member with ~ 0. 1 Mq, by reference to the NextGen 
isochrones, given the errorbar in 7 - K^. Indeed, the 2MASS 
TTj-magnitude is flagged "B"; were the object to be in reality 
fainter at Ks, the 7 - Ks colour would be bluer; closer to the 
cluster isochrone. It would appear most likely that this object is 
a hitherto unrecognised, low-mass but probably not substellar, 
NGC 2264 member 

As a final comment, we note that both these objects have 
2MASS flags gaLcontam = and mp_flg = 0; thus neither are 
associated with objects in the extended source catalogue, nor 
with known solar system objects. The brighter object of the 
two has a confusion flag associated with the /-magnitude; not 
an uncommon occurence in regions of high stellar density. 
Presumably this might be because of the proximity on the sky 
of the Lamm et al. object LBM6160. Lastly, both appear as 
faint point sources on inspection of the 2MASS quicklook K^- 
band images. 

In summary, it is apparent that while the membership of 
these two objects in NGC 2264 remains rather uncertain, and 
in spite of the fact that they do not lie close to theoretical 
isochrones for this cluster, simple arguments show that it is 
highly unlikely that they are either foreground dwarfs, because 
of their Ay, or background giants, because of their low galac- 
tic latitude, faintness, and large derived distances. Therefore, 
they remain excellent candidates for NGC 2264 membership, 
in which case their 7-magnitudes place one quite highly red- 
dened object at ~ 0. 1 (NextGen) and suggest the faintest is 
a cluster member with mass near 30Mjup (DUSTY). 

4.3. Treatment of errors in dereddened magnitudes 

Before concluding this study, we would like to consider fur- 
ther these ten most probable NGC 2264 members, in particu- 
lar with a view to investigating contamination by foreground 
M-dwarfs and also how uncertainties in the dereddened magni- 
tudes translate to mass uncertainties. By inspection of the error- 
bars and magnitude of the reddening vector in Fig.|3 we will 
adopt uncertainties between + 1 and + 3 mag. in Ay for the ob- 
jects with 2MASS flags A and C respectively. In general, for 
these red (faintest at J) objects, poor accuracy in the 2MASS 
7-magnitude suggests that J is fainter and the J - H colour 
is larger than given in Fig.|3] and Ay correspondingly greater 
Therefore in practice, because Ay is rather more dependent on 



12 - ' NextGen mass \ 
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dereddened I — J 

Fig. 11. Dereddened 1,1 - J diagram illustrating the likely 
uncertainties on masses once 2MASS photometric errors are 
propagated through the dereddening process. The bold squares 
have 7-mag. flag A for which we adopt AAy = + 1 mag., hence 
A7 is +0.5 mag, A7 + 0.3 mag. and A7 - 7 + 0.8 mag. maxi- 
mum. For the other objects (triangles; J flag B, hexagons; / 
flag C),we adopt AAy = ± 2 and 3 mag. respectively, with cor- 
respondingly larger errorbars in 7 and 7-7. Dash-dot lines are 
5 Gyr NextGen isochrones for distance moduli 4 (as in Fig.llO> 
and 6. Other isochrones are as Fig.llOl 



7-77 than 77-7*: (Fig.|3}, we have used the 7-magnitude flag A, 
B or C to determine AAy = ± 1, 2 or 3 mag., with corresponding 
A7 and A7 from the usual relations (Rieke & Lebofsky 1985, 1, 
approximated in Fig.^] Here, we repeat Fig.liolplotting onlv 
the 10 objects discussed in detail above, showing errorbars re- 
sulting from the uncertainties in dereddening. It is clear that 
even for a member of this set at 0. 1 Mq, with the largest dered- 
dening errors, the final derived mass is nevertheless restricted 
to a range from ~0.3Mo (NextGen) down to the substellar 
limit or below, with the caveat that Ay is more likely to be 
under- than over-estimated for the faintest objects and masses 
are therefore likely to be at the upper end of the given range. 
For objects with the best 7-band photometry, the errors on the 
final masses are quite small; the five objects with 7-flag A (bold 
squares in Fig.ll 1> clearly lie within ~0. 1-0.2 M© if cluster 
members. Furthermore, the large error in the dereddened 7-7 
colour for the faintest and reddest candidate does not rule out 
its being a ~ 30 Mjup member with reference to the NextGen 
or DUSTY model isochrones. With regard to contamination 
by foreground dwarfs, the current data are unable to rule out 
this possibility, and the main group of candidates have dered- 
dened locations compatible with a 5 Gyr isochrone at distance 
modulus 6 (Fig. ll 1> . As has already been made clear, spec- 
troscopy is required to identify young NGC 2264 objects by 
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Fig. 12. Spatial location of all 79 candidate objects plotted on 
the optical (TJ-band) DSS image which spans -40' x40'. The 
10 objects discussed in Sect. 4.1 and 4.2 are overplotted as 
larger 20" circles. The fields of view of the two 12K fields 
observed are shown, and extend in RA beyond the DSS image. 
North is up and East to the left. 

their low surface gravities. It is interesting to note, though, that 
if a foreground object (at 60 pc) the faintest object in our sam- 
ple is itself at the NextGen BD limit. In summary, given the 
likely uncertainties on the final masses and those inherent in 
the model predictions, all ten objects remain good candidates 
for low-mass, NGC 2264 members and possibly cluster brown 
dwarfs, worthy of further examination. 

5. Concluding remarks 

We have presented our initial findings from a deep, wide-field 
CFH12K /,z-band survey of ~0.6deg2 in NGC 2264, which 
is complete to / ~ 22, several magnitudes deeper than previ- 
ously published surveys. The area surveyed is shown in Fig.ll2l 
where the locations of our sample of 79 candidate members 
are overplotted on the iJ-band DSS image. By cross-correlation 
with 2MASS, we have been able to accurately deredden all 
our sample, finding Av variable, between ~ 1 and ~ 15, as ex- 
pected from the clear strong and variable extinction apparent 
in the image of Fig. [21 Our first important conclusion is that 
in a study of this type, of any similar region, all near-infrared 
colours are required to deduce Av and therefore to be able to 
compare dereddened photometry with the predictions of model 
isochrones. 

In doing so, we have found that all our sample have pho- 
tometry consistent with their being NGC 2264 members with 
masses ranging between solar and near the substellar limit. 
Since all the objects have 18, the most massive candidates 
are highly reddened, and we only probe close to the BD limit 
for low Ay. We cannot at this stage rule out some contamina- 
tion by background giants, although significant contamination 
by such objects is unlikely. We have examined thoroughly the 
cases of the reddest objects with low Av, and find that all are 



potentially members with a mass very close to the substellar 
boundary or below; one may be a member with significantly 
lower mass. Alternative explanations remain possible, but good 
arguments can be made to refute them. Infrared spectroscopy 
is required to finally settle the issue. 

Still, we have not yet been able to probe the substellar 
region with certainty, since the 2MASS survey is not quite 
deep enough to provide counterparts to all 236 optical can- 
didates; this is not surprising, since at 1-22 and assuming 
zero reddening, a substellar member might have I - Ks~3.5 
(by reference to both observed colours for spectral type ~ M7 
and NextGen isochrones). Hence Ks would be 18.5, well be- 
yond the reach of 2MASS. Deeper near-infrared photome- 
try is needed; thus NGC 2264 is an excellent target for the 
next generation of wide-field near-infrared surveys, including 
the UKIRT/UKIDSSAVFCAM survey (for which NGC 2264 
will be observed as part of the Galactic Plane Survey), or 
CFHTAVIRCAM. 
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